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Upper bounds on error probability are derived for data transmission 
systems which are subjected to gaussian noise and to the removal of the 
low-frequency components of the signal. This error probability can be quite 
low for random data, even though the eye pattern is closed. Both standard 
format and partial response signaling are considered, as are binary and 
multilevel alphabets. Numerical results are given for a high-pass filter 
containing a single pole and for a cascade of several such identical filters. 

I. INTRODUCTION 

It is frequently desirable, or unavoidable, that the low-frequency 
components of a data signal be eliminated. This may occur through 
the use of capacitor or transformer coupling in the terminal equip- 
ment or in the baseband transmission facilities. Another instance 
results from the necessity of removing low-frequency baseband com- 
ponents before modulation in order to provide a spectral guard band 
in the vicinity of the carrier frequency. 

Since dc is usually completely attenuated, no linear operation can 
correct for low-frequency removal. One commonly used approach 
uses nonlinear feedback to restore the low-frequency components. 1 
Another solution to this problem involves dc-free signal formats. 2 - 3 

We evaluate the penalty resulting from the removal of low-fre- 
quency components from a standard format data signal (Nyquist I 
shaping) and a partial response signaling format (multilevel exten- 
sion of duobinary with precoding.) 4 Clearly, in both of these cases, 
the degradation is most severe when the transmitted data sequence 
contains long strings of identical digits. In fact, when the system 
bandwidth is less than the signaling rate, which is usual in data 
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communication systems, the received signal will be zero. This follows 
from the fact that for a periodic input impulse train the lowest fre- 
quency components are at dc and the signaling frequency, both of 
which are filtered out. However, the degradation of a random signal 
can be quite small when the cutoff frequency of the offending high 
pass filter is far below the signaling rate. 

We consider binary and multilevel data-transmission systems with 
signaling formats as above, degraded by a single-pole high-pass filter 
or a cascade of such filters. The systems are evaluated for error proba- 
bility in the presence of additive gaussian noise. A previously derived 
error probability bound 5 is used, which takes the form of a gaussian 
distribution of the signal to noise ratio, in which the larger intersymbol 
interference components subtract from the signal amplitude and the 
smaller ones add to the noise power. 5 In general, the optimum splitting 
of intersymbol interference terms between signal amplitude and noise 
power cannot be determined analytically. We show that for inter- 
symbol interference components, related by a single exponential damp- 
ing factor, an optimum subdivision can be explicitly specified. Where 
the eye is open, the error probability bound is given directly in terms 
of the eye opening to rms noise ratio. 

We also discuss the refinements of the generalized bound in the 
case of interysmbol interference from a single exponential signal tail, 
and then apply the results to Nyquist I shaped and partial response 
signaling formats respectively. Single poles and a cascade of identical 
poles are considered, and numerical results are given for practical 
data system parameters. 

II. DERIVATION OF A SIMPLIFIED ERROR PROBABILITY BOUND FOR SINGLE 
EXPONENTIAL INTERSYMBOL INTERFERENCE 

Reference 5 gives an upper bound for the probability of error in 
the reception of a random digital message perturbed by gaussian 
noise and intersymbol interference. This gives 



P. ^ A exp - 

which is subject to 



t/o - (N - 1) £ /J I 
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where 

N is the number of levels of the input random message. 
c\ is the variance of the additive noise. 
f(t) is the signaling waveform. 

— is the signaling rate. 



n = 



jikT) | for standard format signaling 

m - m 



and 



A = 



2(N - 1) 



N 
2(N 2 - 1) 



AT 



for N level partial response signaling with 
precoding* 



for standard format signaling 

for N level partial response signaling with 
precoding 



We notice that the applicability of the error probability bound to 
partial response signaling formats was not discussed in the original 
paper but is presented here as a further extension of the result. 8 

The sets k t K and k $ K include all members except k = 0. It is 
also shown in Ref . 5 that 



u > u 



(2) 



Thus, if the signal sample set {j k } excluding k = is rearranged in 
order of decreasing magnitude to form a set {g k \, then the sums in 
equation (1) may be replaced by 

M 

ktK *-l (3) 



kfK k = .\f + 



9k 



For an arbitrary signaling waveform, -jit), the optimum M [in the sense 
of minimizing the right side of equation (1)] must be determined by a 
trial comparison method as decribed in Ref. 5. 



* In the partial response case, /i must be replaced by /i — f in both numerator 
and denominator summations of equation (1) since only the unintentional inter- 
symbol interference should be included there. 
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For an exponential signal tail, 

U = ff»-i . < r < lj * - 2, 8, • ■ ■ (4) 

Thus, since f(t) is already monotonically decreasing for all t ^ T, 
the ordered sets {/*} and {g k } are identical in this case. 



00 f2 8AT 

Ef2 IlL_. 

= Af+l - 1 * 



(5) 



To minimize the right side of equation (1), it is sufficient to maximize 



[/o - (N - 1) £ f J 
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Differentiating Q with respect to M gives 
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where 



and 



x = r 



(N - 1) 
1-r 



(0 g x g 1) 



Ml - *) < U • 



(8) 



Three separate cases must now be examined. 

(i) If / - (N - 1)A/(1 - r) < 0, then the eye is closed. From 
equation (7) it follows that dQ/dM < for < x ^ 1. Therefore 
the positive maximum of Q occurs at the boundary x = 1, so the optimum 
value of M is M opt = 0. 



LOW- FREQUENCY REMOVAL 



259 



(n) If 



<rl(N 


-1) 


fflM 


r , (N - 1)U 

U 1 - r J 



> 1, 



it is implicit that / — (N — l)/i/(l — r) > 0, and the eye is open. In 
this case it is again true that dQ/dM < for < x ^ l,andM opt = 0. 



(Hi) If 



< 



<rl(N - 1) 



V 3 Al+r/. /o (1-r) 



n < 1, 



it is again implicit that f — (N — l)/i/(l — r) > 0, and the eye is open. 
In this case a positive maximum for Q occurs in the interval < X < 1. 
Solving for the point where dQ/dM = 0, we obtain 



,Mo B t _ 



<xl(N - 1) 



•\" iV /o (iv- D/i V /i 



(9) 



Notice that condition (8) is automatically satisfied. 

Since the solution for M opt as given by equation (9) is not necessarily 
integer, the error probability bound as given by equation (1) must be 
modified in terms of the actual choice of an integer M. We will arbitrarily 
use the next higher integer. Letting [Af opt ] denote the next higher integer 
to M opt and 



z = 3 



N - 



i)fe). 



equation (6) may be expressed as: 

[S, - /»„(! - r IJf -")r 



Q = 



2[al + ILS 



2 21-Uoptl 



M 



(10) 



where 



.hVoptl 



= b 



(T n Z 



*max\'J]i ■'max/ 



_ ..lAf-optJ-JIfopt 



(ID 



b =r 



r < b < 1. 



/^ = (N — l)/i/(l — r) denotes the maximum intersymbol inter- 
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ference and S p = / denotes the signal amplitude. Combining equations 
(10) and (11), 



S»- 



I^(S V - I max ) - balz 
S n - L 



a i r 2„i2 



Since r < 6 < 1, 

In terms of the error probability, 

P. < A exp [-Q] / 12 ) 



{ (^a^fejxa j 



< 4 exp — 

For the situations where M opt = (that is, cases i and w) equation (1) 
becomes 

P. < A exp J— P T- ■ ,^ Wi : =rl- (13) 



>[«s+JG^8te-3«-J 



III. ERROR PROBABILITY PERFORMANCE WITH A STANDARD FORMAT INPUT 
DATA SIGNAL 

Figure 1 is a block diagram of the system considered. Although a 
baseband system is shown, a system using linear modulation and de- 
modulation can readily be fit to this model. P(o>) is the basic shaping 
filter and it is assumed that the receiver is matched to this shaping 
filter. For simplicity, P(a) is chosen to be real. The added noise is 
white gaussian. H(u>) is the narrow high-pass causal filter whose effects 
are considered. Since H (a>) is narrow, it makes little difference whether 
the noise is added ahead of, behind, or somewhere in the middle of 
this filter. 

The source generates symbols randomly from an iV-ary alphabet 
at a rate of \/T symbols per second. The transmitted signal may be 
represented by 

sit) = £ a kP (t - kT) 

*--00 

where the a*'s are independent, zero-mean random variables which take 
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one of N equally spaced values with equal probability, and p(t) is 
the impulse response of -P(w). 

It is assumed that there is no distortion other than H(u>) and that 
Q(oj) = P 2 (co) is a Nyquist shaped filter of bandwidth less than l/T, 
so that 

q(kT) = 0, all A; ^ 0. (14) 

If we let P(0) = 1, then 

g(0) - ~ / Q(«) da = T/P. (15) 

The power of the transmitted signal is 

s = { Zkt! p2(co) d " = ¥ (16) 

where a\ is the variance of a k . 

The signal presented to the sampler may be written in the form 

r{t) = E a k [q(t - kT) + c(« - fcT 7 )] + n(t) 

k --oo 

where e(£) is the error signal caused by the low frequency removal, 
H(w). From equations (14) and (15), 



r(mT) = a„ 



f + c(0) 



+ E a k e[(m - fc)T] + n(m7 1 ). (17) 

k*m 

The effect of the low frequency removal is both the reduction of the 
signal amplitude [since e(0) is negative] and, more important, the in- 
troduction of intersymbol interference. 

The Fourier transform of the error signal is 

E(a) = Q(w)[tf(«) - 1] (18) 

so that 



:(t) = J q(t - xjh-^x) dx 



where h- t (t) is the inverse Fourier transform of [H(w) — 1]. 

In all cases of interest, H(u>) — 1 is much narrower than Q(w). The 
time function h-i(t) therefore is virtually constant over a time interval 
equal to the effective duration of q(t). We may therefore approximate 
q(t) by a delta function, whose area is unity since Q(0) = 1. 



?(0 = J 8(t - x)h^(x) dx. 
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Fig. 1 — System block diagram. 

If H(o)) is causal (which is the case we are interested in), then 

Co t < 



e(t) = 



hh-M 
IMO 



« = o 

t > o 



(19) 



where e(t) is the negative of the impulse response of a narrow causal 
low-pass filter. The generalized bound given in equation (1) can be 
applied to this case as: 



p ^ 2( N - 1) 
P. < N exp 



\h> 


(0) - (N - 1) £ 1 

t-t/k 


e * 1 


2 


2 iV 2 - 1 v , 
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(20) 



The quantity o- 2 is the noise power at the sampler input and is also 
equal to the noise power at the receiver input, measured in a bandwidth 
equal to half the signaling rate. For the AMevel system, 



0"„ = 



N 2 - 1 



In terms of the signal power, equation (16), equation (20) may be 
rewritten as 



2(N — 1) 



f [1 + 9(0) - (N - 1) E | g„ |] 2 1 



,s 



k*K J 



(21) 



(22) 



where g(t) is the normalized error signal 

g(t) = Te(t) 

G(w) = T[H(fa) - 1]. 

To apply the simplified bounds derived in equations (12) and (13), we 
must first specify the high pass filter, H(o>). 
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3.1 Single Pole Filter 

A very common type of low frequency removal results from the 
use of a single capacitor or transformer. The transfer function is 



H(s) = 



ST 



st -r- 1 



where t is the time constant of the low frequency removal circuit. Its 
corner frequency is then 1/(2x7-). From equation (22), the normalized 
error sigDal is 



G(s) = - 



ST + 1 



(23) 



and 



g(t) = -- exp y--ju(t) 
where u(t) is the unit step function. Introducing the normalized quantity 

(24) 



T 

a = — 

T 



then 



g(kT) = 



a 
'2 ' 



k < 



k = 0. 



(25) 



— a exp ( — ka), k > 



Letting 



and 



Tf = 1 + J7(0) 

Tj h =\g k \, k = 1,2, ••■ 



(26) 



r = e , 
the normalized eye opening becomes 

1U l-r ~ Y 2 1 -c- 

Thus, Mo Pl = 0, and equation (13) becomes 



< 0. 



(27) 
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f 



p ^ 2(AT - 1) 
c i^ GXP 1 



2a 



_ S + exp (2a) - lj 



(28) 



When o«l, we may approximate equation (28) by 

1 



D „ 2(iV - 1) 
P. < N exp 



«iS + l/j 



(29) 



The error bounds for binary, 4-level and 8-level systems are plotted 
in Figs. 2, 3, and 4, respectively, as a function of the signal to noise 
ratio, S/<rl , and the normalized reciprocal time constant, a. The dashed 
curves are the exact values for no low-frequency removal. 

U < ■ D 2(AT - 1) , / 1 \ 2(N - 1) . (S)* 
(that is, P. = -A-^-i erfc j— J = — ^p- erfc — , 

where erf c (x) = t^-tj / e~ l ' /2 dtj- 
It is seen that, in the region of 10 -6 error probability, these exact 
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Fig. 2 — Upper bound of the error probability of a binary standard format 
system with a single-pole high-pass filter. 
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Fig. 3 — Upper bound of the error probability of a 4-level standard format 
system with a single-pole high-pass filter. 
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Fig. 4 — Upper bound of the error probability of an 8-1 eve 1 standard format 
system with a single-pole high-pass filter. 
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curves differ from the corresponding bounds by approximately a 
factor of 10 in error probability, or 1 decibel in signal to noise ratio. 
In the binary case, it is seen that a simple high-pass filter with a 
time constant of 50 bit intervals introduces a degradation of only 
about 1 decibel in the region of 10" 5 error probability. On the other 
hand, a time constant of 10 bit intervals leads to totally unacceptable 
performance. For the same amount of degradation and the same 
symbol rate, the 4- and 8-level systems must have high-pass time 
constants respectively 5 and 21 times that of the binary system. 

3.2 Cascaded Single Pole Filters 

In many cases, several single-pole high-pass filters are contained 
in the transmission path of the system. If n identical networks are 
used, then the overall high-pass transfer function is 



*» - (sr-J- 



(30) 



In many cases, a transfer function containing a large number of real 
poles of different values can be approximated by a transfer function 
of the form of equation (30) . 6 

The Laplace transform of the error signal is 



ST 



_\ST + 1 



- 1 



To find g n (t) , we first evaluate 

(g - 1/r)" 1 = l.r 



- exp {-)g 



^(i), w = tQ(-i)V 
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At the sampling times, 

fo, 



9n(mT) = , 
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— a exp ( — ma) £i , 
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(31) 



where again a = T/t. 
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This function may also be expressed in terms of the generalized 
Laguerre polynomial, 7 



tf"»-;SQ^ 



« ! (32) 



g n (mT) = — exp (-ma)L)T "(too), to > 0. 

It has been found empirically in several numerical examples that 
the best error probability bound was obtained when all intersymbol 
interference terms were added to the noise (that is, M opt = 0). The 
resultant bound is therefore 



P. < jj— exp 



na 

2(iV - 1) J V ~ 2 



*[fl + E fe exp (-TOa^-^TOa) 



(33) 



An example of practical interest is the evaluation of the perform- 
ance of a baseband binary 50,000 bits per second data set without 
dc restoration, operating over a transmission facility using trans- 
former coupled repeaters. The transformers each have a corner fre- 
quency of 15 Hz, and therefore a time constant of 

- = 10.6 msec. 



2tt X 15 
so that 

« ■ i&sr - ° 00188 - 

The results of Fig. 2 indicates a degradation of only about 0.1 
decibel when a single transformer is introduced. However, several 
transformers are usually present in actual systems. The error signals, 
g„(t), and error probability bounds have been computed for both 14 
and 28 transformers. The error signals for these two cases are shown 
in Fig. 5. Remember that one millisecond is equal to 50 bit intervals. 

Figure 6 shows the error probability bounds for these situations; 
28 transformers lead to unacceptable performance while 14 transformers 
introduce a degradation of 3 decibels at 10~ 5 error rate. It is significant 
that n transformers produce more degradation than a single transformer 
with a corner frequency n times greater. Also, under the assumptions 
of this paper, all of the above results apply independently of the roll-off 
characteristic of Q(w), as long -as it is a member of the Nyquist I class. 
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Fig. 5 — Errors signal for a cascade of transformers with 15 Hz corner fre- 
quencies. 



-2 



-3 



^ -4 

o 

o 

_l 

-5 



-6 



-7 



8 















;r ^_ 
































—-^^TRAf 


28 
vISFORMERS 


> 


S \ 












\ \ 
\ 


N 




14 
TRANSFORMERS 




EXACT \ 

NO > 
IMPAIRMENT 


\ NO 

^ \ IMPAIRMENT 










\ \ 
\ \ 
\ \ 






"\ 



10 



12 



14 16 18 

SIGNAL /NOISE IN DECIBELS 



20 



Fig. 6 — Upper bound of the error probability of a 50,000 bit/sec binary sys- 
tem with a cascade of transformers with 15 Hz corner frequencies. 
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IV. ERROR PROBABILITY PERFORM AN CE WITH AN iV-LEVEL EXTENSION OF 
A DUOBINARY INPUT DATA SIGNAL 

The system model considered here is identical to Fig. 1 except 
that (i) a precoder which converts the input iV-level sequence {a k } 
to another iV-level sequence {b k } according to the relation 



b n = [a n _, - b n _,](mod N) 



(34) 



is inserted between the source and the transmitting filter, P(o>), and 
(it) a decoder follows the sampler which decodes the received levels 
modulo .A/ to recover the original symbols a n . The important point for 
our application is that by including precoding at the transmitter, no 
knowledge of any symbol or sample other than the received sample, 
r k , is involved in deciding a k . 

Instead of the Nyquist shaping characteristic, the cosine filter is 
used for the composite signal shaping characteristic, Q(u>) = P 2 (w), 
that is, 



T 

Q(«) = cos -co, 



i <- T 



(35) 



The system impulse response is given by 

2 f cosTTt/T "1 
9W " tT Li - ±t 2 /T 2 j ' 

so its values at the sampling instant are 



q[(k - $T] = 



J_ 

2T 

Lo 



k = 0, 1 
k 9* 0, 1. 



The power of the transmitted signal is 






Q(«) rfw = 



2<rl 



(36) 



(37) 



where a 2 b is the variance of b k . If the input symbols a k are equally likely 
and independent, then so are the precoded symbols b k . Thus, a\ = a\ . 
The sampler input waveform, r(t), may be expressed as 

r(t) = f; b k [q(t - kT) + e(t - kT)] + n(() (38) 

where once again e(t) is the degradation caused by the low frequency 
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removal, H{w). Substituting equation (36) in equation (38), 
r[(m - \)T] =r m = (b m + 6 m _0 ^ + & - e (-| 

+ E W(« - * - 1)^] + »[(™ - h)T]. (39) 

If H(a>) is causal as before, then e(— r/2) will be zero. Making the same 
assumptions as in the standard signal format case, we arrive at an ex- 
pression for error probability analogous to equation (21) 

[ ft - (N - 1) 2 | g k n 



/'. < -l ^Jr 1 i ex i> - 



2<r 



2o- 

7T<S 



J + 2-0* 



(40) 



Here we consider only the single pole high-pass filter for #(w). The re- 
sult for a cascade of n identical poles follows immediately. 

4.1 Single Pole Filter 

We start by examining the normalized eye. Letting 

Tfo = 1/2 

Tj k - \g k |; fc - 1,2, ... 



(41) 



and r = e 



_ (N - 1)/, _ 1 _ (JV - l)ae- 
i/o 1-r "2 l-«- <U " 



Thus, M opt = and equation (13) becomes for a « 1 



P, < 2 



exp j — 



2cr °U 



(42) 



(43) 



Figures 7, 8, and 9 illustrate the behavior of the error probability 
bounds versus S/a 2 n for binary, 4-level and 8-level partial response 
signals with the normalized reciprocal time constant, a, as a parameter. 
The dotted curves give the exact values of P, for the case a = 

♦l. ♦ ■ D n ftV ~ A r / W8)* V 

that is, P, = 2^-jp-J erfc (^^-J 

We once again observe that in the neighborhood of 10~ error proba- 
bility, the exact curves for a = differ from the corresponding bounds 
by approximately a factor of 10 in error probability, or 1 decibel in 
signal to noise ratio. 
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Fig. 7 — Upper bound of the error probability of a binary partial response sys- 
tem with a single-pole high-pass filter. 
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Fig. 8 — Upper bound of the error probability of a 4-level partial response 
system with a single-pole high-pass filter. 
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Fig. 9 — Upper bound of the error probability of an 8-level partial response 
system with a single-pole high-pass filter. 

However, to achieve a S/N degradation of only 1 decibel in the 
region of 10~ 5 error probability with a simple high-pass filter, the 
time constant must be about four times that needed for the standard 
format signal. The above statement is true for the binary, 4-level, 
and 8-level cases. This more stringent requirement on the location 
of the low frequency cutoff may be viewed as a tradeoff for the saving 
in bandwidth associated with partial response signaling. 



V. CONCLUSIONS 

Although a high-pass filter will always close the eye pattern of 
i a standard format data signal (Nyquist I shaping) or Hi a multi- 
level partial response signal (duobinary format) , the error probability 
may still be quite low for random data provided that the high-pass 
filter is sufficiently narrow. This effect permits the use of capacitor or 
transformer coupling in the data terminals or transmission facilities. 
Multilevel systems require a longer time constant for these networks 
than do binary systems for the same performance. 

Upper bounds of error probability have been given for binary, 
4-level, and 8-level systems with gaussian noise and a single-pole 
high-pass filter (exponential time response). A binary system with 
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a standard format input signal is degraded by only about 1 decibel 
by a simple high-pass filter whose time constant is 50 bit intervals. 
Four-level and 8-level systems require time constants of 250 and 
1000 baud intervals, respectively, for the same performance. 

A data system whose input is a binary, 4-level, or 8-level partial 
response signal must have a low frequency cutoff which is two octaves 
lower in order to achieve the same performance as a standard format 
system. 

The error signal for a multiple-order pole is an exponential multi- 
plied by a generalized Laguerre polynomial. The performance of a 
system with an nth order pole high-pass filter is worse than one with 
a single pole n times as large. 
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